Surface states scattering from a step defect in topological insulator Bi2Te3 
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We study theoretically the general scattering problem of a straight step defect on the surface 
of topological insulator Bi2Te3 with strong warping effect using a quantum-mechanical approach. 
At high energy where the warping effect is large, an incident electron on a step defect running 
along r — M may exhibit perfect transmission whereas on a defect running along F — K has a finite 
probability to be reflected and may even exhibit resonant total reflection. The transmission property 
in the latter case is also sensitive to whether there is particle-hole symmetry in the system. Although 
backscattering is prohibited by time reversal symmetry, the nearly normal incident electron on a 
defect running along F — K has a finite reflection. This is interpreted as the consequence of the 
existence of decaying modes localized at the defect, acting as a magnetic barrier for the propagating 
modes. The predicted Friedel oscillations and the power-law decaying behavior of the local density 
of states (LDOS) near the defect are in good agreement with recent scanning tunneling microscopy 
experiments on Bi2Te3. The high-energy LDOS of the surface states is also found to show the 
multi-periodic Friedel oscillations, caused by competing characteristic scattering processes. 



PACS numbers: 72.10.-d, 73.20.-r, 



I. INTRODUCTION 
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Since the prediction of three dimensional (3D) strong 
topological insulator {Tl)r which is characterized by a 
bulk gap and an odd number of gapless Dirac cones 
on the surface^'"— it has been found by angle-resolved- 
photoemission spectroscopy(ARPES) to be realized in 
Bi^Sbi-^^-^ BiaSear^i^ and BiaTeg^ii^ materials. The 
surface states of a TI are two-dimensional (2D) helical 
Dirac fermions, topologically protected by time rever- 
sal symmetry. These fermions dominate the quantum 
transport of a TI, and may give rise to potential ap- 
plications in the future electronic devicesi^ In the pres- 
ence of imperfections on the surface of a TI, the in- 
terference patterns of electrons can be probed by scan- 
ning tunneling microscopy (STM), which directly mea- 
sures the LDOS near the imperfections. Since surface 
electrons are prevented from backscattering due to time- 
reversal symmetry, it is more difficult for them to be 
scattered, compared with electrons in conventional met- 
als. For 2D Dirac electrons, the Friedel oscillations of the 
LDOS near a nonmagnetic impurity or a line defect are 
predicted to show a y^-^^ Hiiz qj. ,,-3/2 ^-_15 asymptotic 
power-law decay with r as the distance from the imperfec- 
tion, consistent with recent STM experiments on Tlsi^. 
Although the imperfection scattering effect on the sur- 
face is well understood for pure 2D Dirac fermions, both 
in terms of TIs and graphenefii much less is known for 
the case with a distorted Dirac cone caused by the crys- 
tal symmetry of TI materials lii^iii^ Among the discovered 
3D TIs, Bi2Te3 is found by ARPES to have a strong 
warping effect while surface electronic structure 
probed by STM experiment a^^i^^" — is still not conclusive. 
Therefore further theoretical and experimental studies 
are needed. 



In this paper, based on a quantum-mechanical ap- 
proach we explore the electronic structure of the surface 
states in a TI with a strong warping effect, under the 
influence of a straight atomic step defect, or edge de- 
fect, which is modeled by us as a one-dimensional delta 
functionj^ We flnd that at higher energy where the warp- 
ing effect is large, there are several critical k points on the 
equal-energy contour. An incoming electron with these 
momenta will be totally reflected or perfectly transmit- 
ted. When the defect is along F— K, the existence of local- 
ized decaying modes causes a finite reflection for nearly 
normal incident electrons. In another word, as long as 
the incident direction is not perfectly normal, finite re- 
flection occurs. The Friedel oscillations of high-energy 
LDOS are dominated by the competition between several 
scattering processes. Within a sufficient long distance 
(lOnm-lOOnm) from the defect, the asymptotic Friedel 
oscillations of LDOS at low energies are found to be best 
fitted by a power-law decay function, while that at higher 
energies can be hardly fitted. The Fourier transform of 
the LDOS is predicted to show a generic broad peak at 
zero momentum, which can be seen as the observable fea- 
ture of the existence of the decaying modes near the step 
defect. 

The paper is organized as follows. We introduce our 
model and method in section II, where the scattering 
wave function and its corresponding boundary condition 
in the presence of warping effect are discussed in detail. 
In section III, we demonstrate the warping effect on the 
transmission property of an incident electron, and then 
give the physical explanation of the phenomenon of the 
finite reflection for nearly normal incidence when the de- 
fect is along F — K. In section IV, we show the numerical 
LDOS for the two situations where the step defect runs 
along F — M and F — K respectively, and compare them 
with STM experiments. The LDOS is then Fourier trans- 



2 



formed to further analyze the electrons' interference pat- 
terns near the step defect. In section V, we summarize 
our results. 



II. MODEL AND METHOD 

For the energy range we focused on, we assume the 
interaction between the surface states and bulk ones can 
be totally neglected, so that the property of the sur- 
face states can be explored independently. ARPES ex- 
periments have revealed that Bi2Te3 has a single Dirac 
cone on its surface;^ with distortion by a cubic spin-orbit 
couplingi^ which still respects the three-fold symmetry 
of Bi2Te3 crystal. Therefore the single-particle Hamil- 
tonian for the surface electrons of Bi2Te3 can be given 

by 

+ \pM-ipl)<y^. (1) 

where Px = —ihdx, Py = —ihdy are the 2D momentum 
operators of surface electrons, and cr = {crx,cry,az) are 
the Pauli spin matrices, v is the Fermi velocity and A the 
warping parameter. The first term has been introduced 
to account for the possibility of particle-hole asymmetry. 
In unit of fi, = 1, the upper and lower bands in k space 
are E^ = ^± with 

EU = y^z;2(fc2+fc2) + A2fc2(fc2_3fc2)2. (2) 

For BiaTes, we choose v = 2.55eV • A, A = 250eV • A^, 
which produce the Fermi surface in good agreement with 
experimentsi^ Several representative equal-energy con- 
tours (EECs) in the absence of particle-hole asymme- 
try are shown in Fig.l, where the shapes of the curves 
change from a circle to hexagon and then to concave 
hexagrams Correspondingly the eigen-spinors for the 
upper and lower bands can be expressed as xj^^-* = 

;#t( with 0k = XkxiPx ~ ikl) and ni^) 

the normalization factors. One immediate consequence of 
the warping effect on the spinors is that electron spin ori- 
entation s =< or >= ±E^^{—vky,vkx,4'k.) has an out- 
of-plane spin componenti^i with alternating signs along 
angular direction, leading to the spin texture structure 
of the Dirac conei^ 

To explore the surface atomic step effect, wc model the 
step as a delta- function scattering potential C/(r), rather 
than a step-function potentialJ^ii^ This is because elec- 
trons on the upper and lower surfaces on both sides of 
the step are expected to have the same surface poten- 
tial and there is no potential difference across the step 
defect. Notice that model Hamiltonian (1) is only well 
defined at relatively lower energy. The problem with the 
step-function potential is that if the potential difference 




kx 

Figure 1: The equal-energy contours in the absence of 
particle-hole asymmetry for four different energies, which are 
measured referenced to the Dirac point. The red and green 
solid dots are the pairs of the extreme points which are respon- 
sible for the LDOS oscillations when the step defect is running 
along y (T — M) or x (T — K), respectively. Some characteristic 
scattering wave vectors are shown explicitly (solid arrows). 

between the two surfaces is too large, the energy of one 
side of the defect will be beyond the well-defined lower 
energy region, causing the problematic conclusion. In 
this paper we focus on the two representative situations 
where the step extends along either T — M or T ~ K 
with U{r) given by U6{x) or U6{y) respectively. The 
step scattering problem is treated quantum mechanically, 
since this approach has been proved to be very successful 
in graphenaii in studying Dirac fermion scattering prob- 
lems. We remark here that very recently this quantum- 
mechanical approach has been applied to study the warp- 
ing effect of TI for step defect extending along T ~K^^^ 
modeled by step-function potential. 

Step defect along y(T — M) direction. An incident elec- 
tron plane wave ipki'"^) = ^^^^ ''Xi^'^ from one side with 
momentum k = {kx,ky) and energy E{> 0) will be re- 
flected back to the same side or transmitted into the other 
side. Since ky is a good quantum number and energy E 
is conserved in the scattering process, naively, the re- 
flected and transmitted waves will be characterized by 
kr = {—kx,ky) and k. Actually, for fixed ky, the equa- 

.2 

tion 2^ ± E]^ = E which determines the reflected and 
transmitted wave vectors kx is a sextic algebraic equation 
given by, 

k^ - {&k^ + i??)/cl4 + (9fc;4 - 2<2fc;2 + 2E'J + l)k^ 
+ {-E[fky^ + {2E',E' + l)k;^ -E^) = Q, (3) 

where the dimensionless quantities k^ = kxO,, ky = kya, 
E' = E/E* and E'^ = Ea/E'\ with the length scale 
a — ^yX/v, energy scale E* = v/a, and the particle-hole 
asymmetric characteristic energy Ea = (2m*a^)~^(a w 
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Inm, E* 260meV for 612X03). This equation has six 
roots in total: ifc^-Q., a = 1,2,3. In the previous 
studies,—!^ only two real roots have been taken into ac- 
count. To our knowledge, this six- root scattering mech- 
anism has not been considered before to study the in- 
terference patterns of electrons for defect along F — M, 
which will be concentrated on in this paper. For different 
ky, the solutions for any scattering states can be further 
classified into two categories. 

For type I solution, fc^. 1, kx.2j ^a:.3 E^rs all real num- 
bers, as demonstrated in Fig. 2(a) and Fig. 2(b). This 
solution becomes possible when energy E is above Ed 
{Ed = VTT/33/4£;* « 1A5E* in the case of K = 0), 
which is the critical value of energy whose EEC has in- 
flection points fulfilling {dky/dkx)E = {d^ky/dk^)E = 0. 
The solution indicates that an incoming electron wave 
from the left will have three reflected waves propagat- 
ing towards the left, and three transmitted waves prop- 
agating towards the right (see Fig. 2(c)) . Interestingly, 
both the transmitted and reflected waves have one hole- 
like propagating wave satisfying kxVxi}^) < 0, while the 
other twos are electron- like satisfying kxVxOi-) > (see 
Fig. 2(a)), with Wa;(k) = {dE/dkx)k the electron's group 
velocity along x axis. Here k^^i-, kx^2, k^.s are so cho- 
sen that Wx(k) > 0, i.e., fc^^ 1 > 0, fc^, 2 < 0, fc^; 3 > 
(Fig.2(b)). 

For type II solution, k^^i is a real number while the 
other four roots with relation kx^2 = —ikx,3)* are all com- 
plex ones, symmetrically distributed in the k^ complex 
plane, as demonstrated in Fig. 2(d) and Fig. 2(e), since ac- 
cording to Eq.(3), a complex root k^ implies —k^ and ±fc* 
are also complex roots. This kind of solution is always 
possible regardless of energy E. An incoming electron 
wave from the left will have one propagating reflected 
wave and only one propagating transmitted wave (see 
Fig. 2(f)), similar to the case appearing in most of con- 
ventional metals. However, the presence of the complex 
wave vectors ±kx.2, i^^.a means that there still exist two 
decaying modes on both sides of the step defect which at- 
tenuate quickly when away from the step with the same 
attenuation length | lmkx,2 \~^- Here k^^i, fca;,2, kx^3 are 
chosen as kx^i > 0, Im(A:a;,2) = ^T^{kx,3) > (Fig. 2(e)). 

Taking these considerations into account and denoting 



^k(r) 



{skx,a,ky), with 



VK(k)l 

one can write down the following expressions for the wave 
function of a generic scattering state with incident mo- 
mentum k = k'*": 

3 

M/((r) = ^k(r)-K5^r^^^k~=^(r), xz;,(k) < 

13=1 

3 

*k'(r) = ^t^/3Vk=.(r), xVx{^)>Q. (4) 

13=1 

where and (s = ±, a,/3 = 1,2,3) are the re- 
flection and transmission amplitudes for the scattering 
process. Since an incident electron must be a propagat- 
ing plane wave, k has to be real, indicating that k*" can 
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Figure 2: (a), (d) ((g), (j)): Two representative scattering 
processes when an electron is incoming and then reflected 
or transmitted from the step defect which runs along y (x), 
where energy E and momentum ky {kx) are preserved in each 
scattering process. The corresponding six (four) k^ {ky) solu- 
tions in the kx{ky) complex plane for the scattering states are 
displayed schematically in (b), (e) ((h), (k)). Only the propa- 
gating reflected and transmitted waves for each situation are 
displayed schematically in the (c), (f) ((i), (1)). 



be any one of the six momenta k^^, k^^, k^^ for the first 
case, whereas k can be just one of the two momenta k^^ 
for the second case. Therefore, for type I solution, on the 
basis of (k+^, k+^, k+^, k~^, k~^, k~^), one can construct 
a 6 X 6 scattering matrix S as follows 



S = ( 



) 



(5) 



where 3x3 matrices t*, r'^ {s = ±) are defined as t" = 
itil3): = (r^^) {a, 13 = 1,2,3). For type II solution, a 
2x2 scattering matrix S on the basis of (k+^, k^-'^) can 
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be then constructed accordingly, 

s = ( *ii ) (6) 
'•11 

Since the current operator Vx can be expressed as Vx = 
dH/dpx = Px/'m*+vay+3X{Px—pl)crz, it can be checked 

that < \ Vx \ i^k >~ \v°^(y} \ ■ introduction of 

the factor "^^^^ into Eq.(4) is to make the expressions 

for the current conservation more physical and apparent, 
resulting in that S is a unitary matrix satisfying, 

SS+ = S+S = 1. (7) 

Let k = k+-'^, we have to determine the six parame- 
ters rp = and t/^ = for (3 = 1,2,3, so we need 
six equations or three spinor equations as the boundary 
conditions. Thanks to the fact that the Schrodinger's 
equation { H{-idx,ky) + U5{x)} 'l'k(r) = £^^'k(r) corre- 
sponding to Hamiltonian (1) is a third-order partial dif- 
ferential equation with respect to x, due to the warping 
term, we have the following boundary conditions: 

*k^|r=(0,y) = *klr=(0,y), <9^*k^|r=(0,y) = 93;*klr=(0,y) 
a^aMK' - 5'*k)|r=(0,,) =»^*k'|r=(0,,), (8) 

which determine exactly the six parameters, with the di- 
mensionless ratio rj defined by 77 = — . The above 1st and 
2nd conditions are actually the continuities of the scat- 
tering wave function and its 1st derivative at the defect 
line, respectively. The third condition is about disconti- 
nuity of the 2nd derivative of the wave function due to 
the delta-function potential, derived by integrating the 
Schrodinger's equation between x = 0~ and a; = 0+. 

When these scattering states are fully determined by 
the numerical calculations, by taking into account both 
contributions of the reflected waves from the same side 
and transmitted waves from the other side, one can ob- 
tain the symmetric LDOS near the step defect by sum- 
ming over all possible independent scattering states, 

p{E,x;x > 0) 

xS{E-E^) (9) 

= ^ « 2m'^ l*k(r)P + iK'irrm (10) 

Jeec Sn^NkVxik) 

where = {~x,y). The reflection symmetry of the 
wave functions \I'^^(r) — \l'^^(rr), and VxCkr) = —Vx(k) 



have been used in the derivation of the above equations. 
Here iVk is the normalization factor for the scattering 
state, which is equal to 2/|z;2;(k)| if kx belongs to type 
II solution, but given by l/|wa;(k)| + Y.l=i{ + 
l^aP} /|w:r(k+")| otherwise, with k+i = k. We re- 
mark here that TVk is important to be included in the 
expression to give the correct LDOS since it is intro- 
duced to fulfill the scattering states' orthonormal rela- 
tions A^jT^ < ^'k|*k' ^ ^')- Eq.(lO) is another 
expression for the LDOS which is a contour integral over 
ky on the EEC. In next sections, by making use of Eq.(9) 
and Eq.(lO), we shall do the numerical calculations on 
the LDOS and perform the scaling analysis of the Fricdel 
oscillations respectively. 

When the step defect is running along other direction 
than r — iC or its two equivalent directions, a straight- 
forward discussion leads to an analogous six-root scatter- 
ing mechanism, indicating this is generic feature of the 
scattering process of the topological surface states in the 
presence of the hexagonal warping effect. 

Step defect along a; (F — K) direction. A generically 
incoming electron with momentum k has two transmit- 
ted waves and two reflected waves, since with kx a good 
quantum number in this situation, i E^ = E, 

i.e., Eq.(3), is a quartic equation of ky. It gives four 
roots: zLky^a, a ~ 1,2 (see Figs.2(g)-(1)). In this situ- 
ation, we also have two types of solutions. For type I, 
ky,i, ky^2 are both real numbers, as shown in Fig. 2(g), 
which occurs when energy is above another critical value 
Ec2iEc2 = V7/6^^^E* « 0.69£;* in the case of E^ = 0)^ 
at which the EEC become concave, or the EEC has in- 
flection points fulfilling {dkx/dky)E = {d'^kx/dky)E ~ 0. 
To have the same sign of the group velocity VyCk), ky^i, 
ky^2 are chosen as ky^i > 0, ky^2 < 0. For type II solu- 
tion, which is always possible regardless of E, ky i is real 
whereas ky^2 is complex. ky^2 is actually purely imaginary 
due to the fact that any complex root ky of Eq.(3) implies 
—ky and ±fc* are also roots, but at most two complex 
roots can be available. This is schematically shown in 
Fig.2(k). Correspondingly the reflected and transmitted 
propagating waves arc displayed in Fig.2(i) and Fig. 2(1) 
respectively for these two cases. Here ky^i, ky^2 are cho- 
sen as ky^i > 0, Imky^2 > 0. The exception is when 
kx = 0. Instead of a quartic equation, Eq.(3) in this par- 
ticular case is a quadratic equation, which has only two 
real roots:±/cj,. The scattering state at this special direc- 
tion is free of warping parameter and so is unaffected by 
the warping effect. 

For an incident electron with momentum k = k*" (s = 
±,a = 1,2), the wave function for the scattering state 
can be given analogously, 

2 

*^(r) = V^k(r) + 5]r^^V^k-=''(r), yvyi^) < 

/3=1 

2 

*k'(r) = ^t?,^V^k=^(r), y«,(k)> 0,(11) 

/3=1 
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with Vk(r) = \ Vk(r), k'*" = [k^^sky^^)- Here 

r^p and (s = ±, a, /3 = 1,2) arc the reflection and 
transmission amphtudes for the scattering process. Since 
k must be real, k^" can be any one of the four momenta 
k , k for type I solution, while can be only one of the 
two momenta k^^ for type II solution. For the first case, 
on the basis of (k+^, k+^, k^^, k~^), one can construct 
a 4 X 4 unitary scattering matrix S which has exactly 
the same form to Eq.(5) except = (i^^), — (r^p) 
(s = ±, a, /3 = 1, 2 ) are all 2 x 2 matrices. For the second 
case, a 2 X 2 unitary S matrix with the exactly same form 
to Eq.(6) can be constructed. 

Consider k = k+^, we need to determine the four pa- 
rameters rjs = and tp = t^^ (/3 = 1,2) which satisfy 
the following boundary conditions: 



II \ 



II 



klr=(a:,0) 



aiE^-'Sk^a,){dy^i' - 



9yK} lr=(.,0) 
';*k'|r=(.,0)- 



(12) 



Since the corresponding Shrodinger equation 
{ H{k^,-idy) + U5{y)} *k(r) = S*k(r) with re- 
spect to y is actually a conventional sencond-order 
partial differential one. Accordingly, the LDOS p{E, y) 
can be shown in an analogous way to have the following 
form, 

p {E,y;y>0) 

E / ^{ + \K\rr)\'} S{E ~ EQ 



s=± • 



EEC 



{ l*k(r)P + l*k'Min (13) 



where = {x,—y), and the normalization factor iVj. 
is equal to 2/|'i;j,(k)| if ky belongs to type II solution, 

but given by l/|z;,(k)| + ^Lii K? + K?} /I%(k+")l 
otherwise, with k+^ = k. 

For simplicity of analysis, in the following discussions, 
1 / m* is assumed to be zero and the effect of the particle- 
hole asymmetry will be neglected unless otherwise men- 
tioned. 



III. TRANSMISSION PROPERTIES 

For defect along y {T — M) direction, an incident elec- 
tron at lower energy with momentum k has only one 
transmitted wave propagating along the same direction, 
and only one reflected wave propagating along k^ = 
{—kx,ky), with the other four non-propagating decay- 
ing modes localized on both sides of the defect(Figs.2(d)- 
2(e)). At higher energy E > Ed, the scattering states 
with three transmitted and three reflected propagating 
modes are available(Figs.2(a)-2(b)). Since the step defect 
is nonmagnetic and so preserves time reversal symmetry. 
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Figure 3: Total reflection coefficient R of an incident electron 
as a function of the non-conserved momentum along EEC for 
the defect running along y(r — M) direction for the left panels, 
or along x(r — A') direction for the right panels, at different 
energies, (d) and (h) are the blowups of the oscillating parts 
of E=400meV curves in (c) and E=300meV ones in (g), re- 
spectively. Here U is measured in unit of eV • A. The insets 
in (d) and (h) are the relevant parts of the EECs, where the 
possible critical transmission points are denoted by solid dots. 



the backscattering between kr and k if kr = — k is forbid- 
den. In the left panels of Fig. 3 we show the total reflec- 
tion coefficient R = X]q=i if k •■"-i kaP of an incident 



real 



electron, which clearly exhibits the absence of backscat- 
tering at ky = 0. Total reflection i? = 1 at the extreme 
point kx = is trivial since this just means that an inci- 
dent wave propagating along the step will keep propagat- 
ing without being scattered. Between the backscattering 
point and the trivial point, R changes continuously if the 
incident energy E is so low that there is no other extreme 
points on the EEC (Figs.3(a)-3(b)). However at higher 
energy (i? > Ed) with large warping effect where type I 
solutions of the scattering states are possible for Eq.(3), 
additional extreme points appear (see the points A, B, 
C, D in the inset of Fig. 3(d)), and R take exact values 1 
or at these points (see Figs.3(c)-3(d)). This indicates 
that an incident electron with momentum at points A or 
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D will be perfectly transmitted while with momentum at 
points B and C will be totally reflected. The total refec- 
tions at points B and C are essentially trivial, similar to 
the trivial point at ky = 0, since at these two extreme 
points, Vx = {dE/dkx)ky = -Vy{dky / dkr^) e = 0. The 
existence of these resonant extreme points leads to the 
oscillations behavior of R when k going through these 
points along the EEC (Figs. 3(c)). 

In the right panels of Fig. 3, the total reflection coeffi- 
cient R for defect along x (F — K) direction is exhibited. 
At strong scattering strength, an incident electron may 
be totally reflected at a resonant momentum, which in- 
creases with U . Moreover, the incident electrons with 
momentum at extreme points B and C will still be to- 
tally reflected. However, different from the former case 
of perfect transmission, electrons incident at point A have 
finite probability of being reflected, which also increases 
with [/(Fig. 3(h)). Unusually, the reflection coefficient 
R is not vanishing when kx is approaching (Figs. 3(c)- 
3(g)), seemingly contradicting time reversal symmetry. 
In fact, this is because, as mentioned before, fc^; = is 
a very special direction. For any flnite kx, Eq.(3) which 
determines the solution of ky is quartic, while at exactly 
fca; = 0, it is quadratic. This discontinuity aX kx — G indi- 
cates that the absence of backscattering at exact fc^. = 
may not be true any more at kx = 0±. According to 
Eq.(2), the equation which determines ky when kx ^ Q 
can be given by, 



^ykiki + v 



k^y -E^ = 0. 



(14) 



It has four roots: k^ = islWi^^^ ± ^/v'^ + SGX^k^E^}, 
including two real ones, ± — , as well as two complex ones: 
± 



At exactly fc^: = 0, which corresponds to normal inci- 
dence, only the two real roots are available. The scatter- 
ing process is actually described by a simplifled Hamilto- 
nian H = —vpytJx + U5{y) under the following boundary 
condition, 



= (x,0)j 



(15) 



where 77 = U /v. Here the scattering wave functions 
and VP^^ are expressed as. 



Jkyy 



1 

-1 



Tie 



-ikyy 



,y<o 



^i' = t,e'''yy ( \Yy>Q. (16) 



line, which produces a U dependent phase shift between 
the transmitted and incident waves. 

On the other hand, when kx is approaching but not 
equal to 0, an nearly normal incident electron with small 
flnite kx has always two decaying modes on both sides of 
the defect, whose attenuation length 1/k ~ ^^^j^ becomes 
inflnitesimal small when kx ^ 0. These two decaying 
modes make the first derivative of the scattering wave 
function discontinuous at the defect line. More precisely, 
an incident electron with momentum k = (0±, ky) is spin 
polarized along x direction, while the corresponding two 
decaying modes are spin polarized along y direction and 
are nearly exactly localized at the step edge (Fig. 4(b)). 
Specifically, the scattering wave function for a nearly nor- 
mal incident electron (fc^; — >■ 0) can be thus written as. 
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Figure 4: (a)Reflection coefficient i? as a function of the di- 
mensionless scattering strength r] = U /v for a nearly normal 
incident electron, when the defect runs along x direction. The 
relevant scattering state is schematically shown in (b). In the 
presence of particle-hole asymmetric term, a new additional 
EEC occurs near y axis at large momentum. Reflection co- 
efficients _Ri (reflection to the same EEC), i?2 (reflection to 
the other EEC) on a £ = SOOmeV EEC are shown in (c) 
for U = 5eV • A, while correspondingly the scattering state 
is schematically exhibited in (d). (e) Reflection coefficient R 
on E — ISOmeV EEC for different particle-hole asymmetric 
energies Ea, when the defect runs along y direction. 



This gives ri = 0, = e"*"^, with (/> = 2tan-^{r]/2), in- 
dicating that the absence of backscattering is protected 
by time-reversal symmetry. This is in good agreement 
with the well studied problem in Refs[14,17], where the 
delta-function potential is treated as a rectangular poten- 
tial barrier in the limit of zero barrier width. The only 
consequence of the delta-function step potential is the 
discontinuity of the scattering wave function at the step 



+r2e' 



•^yl ] ),y<0 



,y>o, (17) 
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where k = g^^- According to the boundary conditions 
of Eq.(12), the coefBcicnts can be easily solved to give 

_ -»rjV2 , _ 1 „ „ (»+l)(»)"-»»))/2 , _ 

'1 l-r;2/2+i77 ' ""l l-r;2/2+iT; ' '2 1-172/2+17; ' ''2 

gi'^i'^g ^i^^s to the final result of the reflection 

coefficient, 



can be given by, 







1+17-1/4 ' 



(18) 



This implies the discontinuity of i? at fc^; =0. We remark 
here that although this phenomenon is caused by the 
warping effect, the reflection coefficient R{kx — ?> 0) is 
independent of the warping parameter, which means taht 
the warping parameter is relevant in this particular case, 
even at lower energies. This is a unique feature of a delta- 
function potential. As a comparison, for a step-function 
potentialfi^ii^ one can construct an analogous scattering 
wave function to obtain r2 = ^2 = ''i = 0, ti = 1 due 
to the continuity of the first derivative of the scattering 
wave function at the step line, indicating the continuity of 
the reflection coefficient(i?i(fca: — >■ 0) = Ri{kx = 0) = 
and the absence of decaying modes. 

Since spin is not conserved in the scattering process, 
the localized spin-polarized modes act as a "magnetic 
barrier" for the propagating waves and the existence of 
them makes the nonmagnetic defect "magnetic", which 
leads to the scattering between the two nearly time- 
reversal related states. We explain this as follows. Con- 
sider a nearly normal incident massless Dirac fermion 
without warping effect on a magnetic step defect, whose 
scattering potential is described by {U +Ym-cr)S{y). The 
scattering wave function is described by the exactly same 
equation given by Eq.(16), but under a slightly different 
boundary condition to Eq.(15) with the replacement of 
T] in (15) by 77 + ;^V„j • cr. It can be checked that if V,„ 
^X—T (-277, -773,4), the exactly 



is chosen as V,„/?j = 
same results for ri and ti described by Eq.(16) can be 
obtained. This gives an equivalent physical picture that 
for nearly normal incidence the localized modes can be 
seen as a delta-function magnetic barrier positioned at 
the step defect for the propagating waves. This natu- 
rally explains the phenomenon of finite reflection. 

In more realistic situation, this problem of "presence 
of backscattering" can be solved if a small particle-hole 
asymmetric term is taken into account in Hamiltonian 
(l)(Fig.4(c)). The physical picture is that: If Ea ^ 0, 
there exists an additional segmental EEC around y axis 
at relatively large momenta(Fig.4(d)). Instead of the two 
decaying modes in the case oi Ea = 0, there exist two 
propagating modes at large momenta with spin polariza- 
tion along X axis rather than y axis. Therefore the scat- 
tering wave function for a nearly normal incident electron 



-1 



+ 7'ie 



+r2e-^^«^ ( \ ) ,y <0 



^,1^ = t^e'^^yy ( _\ ) + t2e<'' ( J ) , 2/ > 0, (19) 



where ky = ky + (E^a) . Analogously, the coeffi- 
cients can be determined to obtain t'i = ^2 = 0, r2 = 



V 



1 



-ri+iy/l+iE'^E' ' I ^2 -n+iy/l+4E'^E' ' 

rj = U/v. This gives rise to the reflection coefficients 
i?i(fc.^ ^ 0) = Inp = 0, i?2(fc. ^ 0) = |r2|2 = 
This means a nearly normal incident elec- 



iy/l+iE'^E' 



where 



i1^ + l+4E'^E 

tron has no backscattering with R continuously reduced 
to zero when fc^; — )■ 0, but still has flnite probability to be 
reflected to one segment of the large-momentum EEC, 
with the probability R2 increasing as a function of the 
scattering strength U. 

While whether or not there is particle-hole asymme- 
try dramatically affects the situation where the defect 
runs along x axis, it actually hardly affects the other 
situation where the defect runs along y axis. As an ex- 
ample, at different small particle-hole asymmetric ener- 
gies Ea, Fig. 4(e) shows the reflection coefficient R on 
E = ISOmeV EEC, which is nearly unchanged with Ea- 
This feature is expected since the inclusion of a small 
particle-hole asymmetric term only shifts slightly the val- 
ues of the roots of each solution, but doesn't change the 
types of the solutions for any scattering states. 



IV. LDOS AND FTLDOS 

The electrons' interference patterns due to the scatter- 
ing between states on the EEC can be reflected by the 
LDOS in the vicinity of step defect. Although there ex- 
ist decaying modes for most of the scattering states, the 
asymptotic behavior of the Friedcl-likc oscillations of the 
LDOS is believed to be mainly determined by the inter- 
ferences between the propagating waves. In most cases at 
low energies, the dominant contribution is coming from 
the interference between the incident and reflected prop- 
agating waves, whereas at high enough energies, further 
contributions from the interferences between the trans- 
mitted waves becomes possible and competing, leading 
to multi-periodic LDOS oscillations. At lower energy, 
the numerical LDOS exhibits the behavior of power-law 
decay at long distance from the defect. To explore this 
asymptotic behavior, we assume the long-distance be- 
havior is dominated by the interference between the inci- 
dent and reflected propagating waves and follow the scal- 
ing analysis of Re f^^'^^ on the LDOS oscillations, since 
other possibilities can be discussed straightforwardly in 
an analogous way. This gives the following asymptotic 
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Figure 5: LDOS as a function of the distance from the step 
for [/ = leV ■ A and [/ = 5eV ■ A at different energies E. The 
defect runs along y(r — M) direction. The (red) solid lines are 
the fitting power-law decay sinusoidal functions oc ^ 
with u the decay indices. 



behavior of the LDOS: 5p{x,E) cx sM^+H^ with the 
power-law decay index u = {\ -\- a + (5)/^. Here a, {3 
and 7 are the power exponents of the expansions around 
the extreme points for the quantities: reflection ampli- 
tude r, overlap of the spinor wave functions of incident 

and reflected propagating waves X^'^'^ and the mo- 
mentum transfer Afc^;, where near the extreme points 



oc 5k^, Xi^^^xC^ oc Sk^, Ak, oc Afc - 



■Ski 



In Fig. 5 we show the Friedel-like oscillations of LDOS 
p{E, x) at different representative energies for step de- 
fect along y direction. At lower energy E < 340meV, 
the quasi-period of LDOS oscillations is consistent with 
the inverse of the wave vectors connected by the corre- 
sponding pair of the two extreme points on EEC (see the 
pairs of red circles in Fig.l), whereas at higher energy 
E > 340meV, multi-periodic oscillations become obvious 
owing to the competition of the multiple scattering pro- 
cesses on the EEC (see Figs. 5(g), and 5(h)). The decay 
behavior of the LDOS demonstrates that the oscillations 
decay much more quickly at E = lOOmeV where the EEC 



has a circle shape than at higher energy where the EEC 
has a shape of hexagon or hexagram, in agreement with 
STM experiments fi^i^ The asymptotic behavior of the 
LDOS oscillations a.t E = lOOmeV can be very well fit- 
ted by a x^'^/^ power-law decay sinusoidal function. This 
is in agreement with the scaling analysis, since a — /3 ~ 1 
i.e.; both the reflection coefficient and the spinor overlap 
are zero due to the absence of backscattering between 
the pair of the extreme points (qi in Fig.l), as well as 
7 = 2, giving rise to = 3/2. At energy as high as 
E ~ 300meV, the LDOS oscillations can be well fitted 
by a a;~^/^ power-law decay function(see Figs. 5(e) and 
5(f)). This is interpreted as that the system at this en- 
ergy is dominated by a scattering process between the 
two extreme points connected by a vector q2 as shown 
in Fig.l, where a = /3 = and 7 2. This is anal- 
ogous to the scattering processes occurring in conven- 
tional metals, since the interference scattering occurs be- 
tween the points which have both finite refection and 
finite spinor overlap. At E ~ ISOmeV which is inter- 
mediate between the above two energies, the LDOS can 
be better fitted by a power-law decaying function with 
decay index 1/ w 0.82. This can be understood since the 
EEC a,t E — ISOmeV is nearly nesting. The existence 
of both qi-like and q2-like scattering processes and their 
competition lead to a power-law decay of LDOS with 
decay index i' between 3/2 and 1/2. At high enough en- 
ergies such as £■ = 400meV (see Figs. 5(g) and 5(h)), the 
LDOS oscillations are dominated by multiple scattering 
processes so that the asymptotic behavior exhibits beat 
feature which can be hardly fitted by any power-law de- 
cay functions. 

Accordingly the LDOS p{E, y) for step defect along x 
direction is exhibited in Fig. 6. The LDOS oscillations 
can be fitted by a power-law function only at relatively 
lower energies or at energies around E = Ed whose EEC 
has nesting segments. At E = lOOmeV, the fitting de- 
cay index is about 1.08 (Fig. 6 (a)), quite different from 
the former case at the same energy whose fitting decay 
index v ~ 1/2. This is surprising because at this en- 
ergy, the EEC is nearly a circle and the warpping effect 
is small, which seemingly leads to the conclusion that 
the transport along y direction should be similar to that 
along X direction. This behavior could be understood 
if we note that there exists finite "backscattering" near 
the two extreme points related by time reversal symme- 
try, so a should be instead of 1. /3 is still equal to 
since the two spinors are still orthogonal to each other. 
Therefore v ~ I is expected for the low-energy asymp- 
totic behavior of the LDOS. Taking a small particle-hole 
asymmetric term into account would qualitatively change 
the power-law decay behavior (see Fig. 6(c)). Since the 
absence of backscattering is recovered by this term, the 
power-law decay index v should return back to 3/2, qual- 
itatively consistent with our numerical result(Fig.6(c)). 
The appearance of small fluctuations in the LDOS with 
quasi-period about several angstroms in the presence of 
particle-hole asymmetry is a generic feature which is due 
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Figure 6: LDOS as a function of tlie distance from tlie step for 
(a)U=l, Ea = 0,(b)U=5, Ea = 0, and (c)U=l, Ea = Q.IE* 
at E=100meV, while (d),(e),(f) are the LDOS for U=l, Ea = 
at E=180meV, 300meV, 340meV respectively, where the 
defect runs along x (F — K) direction. The (red) solid lines are 
the fitting power-law decay sinusoidal functions oc ^'"(^J^+'fi) ^ 
with v the decay indices. Here U is measured in unit of eV-A. 
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Figure 7: The magnitudes of the Fourier transforms of the 
LDOS at different energies where the step defect runs along 
y(r — M) direction are shown on the left panels. Those along 
x(F — K) direction are shown on the right panels. The pa- 
rameters are chosen as U=l, Ea ~ for (a), (d), and U=5, 
Ea = for (b), (e), while U=l, Ea = O.IE* for (c), (f). 
Here U is measured in unit of eV • A. The peaks shown in 
Fig.l which are relevant to the characteristic scattering wave 
vectors qi — q5(g4 ~ qs) are exhibited explicitly. 



to the interference scattering between the two extreme 
points on different EECs, one on the original EEC, the 
other on the additional large-momentum EEC(Fig.4(d)). 
At intermediate energies such as E' = 180meV(Fig.6(d)) 
or E = SOOmeV (Fig. 6(e)), the LDOS oscillations can be 
hardly fitted by any power-law decay functions due to 
the presence of destructive interference scatterings. 

To further analyze the interference patterns revealed 
by the LDOS, we investigate the Fourier transforms of 
the LDOS (FTLDOS), Sp{E, k^(ky)), whose magnitudes 
are shown in Fig. 7. The FTLDOS has been used to ex- 
plore the interference patterns of a point impurity on 
the surface of a topological insulator J^i^ The FTLDOS 
curves here are symmetric about zero Fourier momentum 
so let us focus on the positive- momentum part. At lower 
energy with weak warping effect there is always a broad 
peak at kx ~ O(orfcj, = 0). This can be interpreted as fol- 
lows: For each scattering state on the low-energy EEC, 
there exist decaying modes residing in the vicinity of the 
step. Although the decaying modes for different scat- 
tering states have different attenuation lengths, they all 
contribute a peak positioned at = (or ky =0), giving 
rise to the appearance of a broad peak there. Except the 
zero-momentum peak, at lower energy there generically 



exists another peak characterizing the oscillations of the 
LDOS; such as qi peak in Fig. 7 at £' = lOOmeV. How- 
ever at higher energy with large warping effect, multi- 
peak structure appears where one of the peaks is dom- 
inant(see E=400meV curves in Fig. 7). These multiple 
peaks are interpreted as the competition among vari- 
ous scattering processes between the multiple pairs of 
the extreme points on the EEC. For example, when the 
step runs along T — K, there are three competing char- 
acteristic scattering processes at E' = 400mcV(shown in 
Fig.l as the characteristic wave vectors qs, q4, qs) with 
qs process dominating, since it has the lowest decay in- 
dex v = 1/2, while there are two competing character- 
istic scattering processes at E = 340meV with q4-like 
process dominating owing to the absence of q5-like pro- 
cess, in agreement with STM cxperimentj2£ Interestingly, 
there exists an additional peak at £' = 400meV for the 
first situation (see Figs. 7(a), 7(b)) at a lower momentum 

kx ~ 0.04 A . This additional minor peak is recognized 
as a result of the interference scattering process between 
the two points connected by a nesting vector, shown in 
the inset of Fig. 3(d), where the two points lie on seg- 
ments AB and CD respectively. This peak is only pos- 
sible when the warping effect is so large that E > Ed- 
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On the other hand, compared with Ea = case, the 
FTLDOS in Fig.7(c) for the case with K = 0.1£;* is 
nearly unchanged, while that in Fig. 7(f) shows a small 
peak appearing at large momentum, and a sharper peak 
at lower energy indicating the modification of the power- 
law decay index. This further confirm the point that the 
inclusion of a small particle-hole asymmetric term has lit- 
tle effect on the scattering property from a defect along y 
axis whereas has dramatical impact on that from a defect 
along X axis. 

V. SUMMARY 

In summary, we have investigated the effect of a step 
defect on the surface states of a topological insulator with 
strong warping effect in a quantum-mechanical approach. 
Scattering properties are found to depend strongly on the 
extending direction of the defect. At high energy with 
large warping effect, there exist critical directions along 
which an incident electron will exhibit perfect transmis- 
sions when the defect runs along F — M, whereas an inci- 
dent electron will generally exhibit finite reflections when 
the defect runs along F — K. Specifically, for nearly nor- 
mal incidence on the defect along F — K, finite reficction 



always exists, which is explained as the consequence of 
the existence of the localized decaying modes at defect 
line. The Friedel oscillations of the LDOS show power- 
law decay, consistent with STM experiments on Bi2Te3. 
The electrons' interference pattern of a step defect can 
be characterized by the Fourier transform of the LDOS, 
which exhibits a single peak with finite momentum at 
lower energy while shows multi-peak structure with one 
of the peaks dominant at higher energy. 

Note added. When finalizing this work we became 
aware of a recent related unpublished paper^^ in which 
by making use of a similar framework of a quantum- 
mechanical approach, only the case for the step defect 
running along F — K is considered and an asymptotically 
exponential decay of the LDOS is found. 
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